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DETAILED ACTION 

Claim Rejections - 35 USC § 101 
35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for Patent 
Subject Matter Eligibility" (Official Gazette notice of 22 November 2005), Annex 
IV, reads as follows: 

Descriptive material can be characterized as either "functional descriptive material" or "nonfunctional 
descriptive material." In this context, "functional descriptive material" consists of data structures and 
computer programs which impart functionality when employed as a computer component. (The 
definition of "data structure" is "a physical or logical relationship among data elements, designed to 
support specific data manipulation functions." The New IEEE Standard Dictionary of Electrical and 
Electronics Terms 308 (5th ed. 1993).) "Nonfunctional descriptive material" includes but is not limited 
to music, literary works and a compilation or mere arrangement of data. 

When functional descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory in most cases since use of 
technology permits the function of the descriptive material to be realized. Compare In re Lowry, 32 
F.3d 1579, 1583-84, 32 USPQ2d 1031, 1035 (Fed. Cir. 1994) (claim to data structure stored on a 
computer readable medium that increases computer efficiency held statutory) and Warmerdam, 33 
F.3d at 1360-61, 31 USPQ2d at 1759 (claim to computer having a specific data structure stored in 
memory held statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 
1760 (claim to a data structure per se held nonstatutory). 

In contrast, a claimed computer-readable medium encoded with a computer program is a computer 
element which defines structural and functional interrelationships between the computer program and 
the rest of the computer which permit the computer program's functionality to be realized, and is thus 
statutory. See Lowry, 32 F.3d at 1583-84, 32 USPQ2d at 1035. 



Claim(s) 1-11 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter as follows. Claims 1-1 1 defines an 
image processing apparatus [the apparatus is just a program or software as is 
recited in the specification (see page 5 of the specification, "computer 
programs that attain the functions of such apparatuses") embodying 
functional descriptive material. However, the claim does not define a computer- 
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readable medium or memory and is thus non-statutory for that reason (i.e., 
"When functional descriptive material is recorded on some computer-readable 
medium it becomes structurally and functionally interrelated to the medium and 
will be statutory in most cases since use of technology permits the function of the 
descriptive material to be realized" - Guidelines Annex IV). That is, the scope of 
the presently claimed apparatus [or merely a program or software] can range 
from paper on which the program is written, to a program simply contemplated 
and memorized by a person. The Examiner suggests amending the claim to 
embody the program on "computer-readable medium" or equivalent in order to 
make the claim statutory. Or instead, the Examiner suggests amending the 
claim to embody actual hardware components to the independent apparatus 
claim to show that an actual apparatus is being claimed instead of software. Any 
amendment to the claim should be commensurate with its corresponding 
disclosure; if the Applicant chooses to include a computer-readable medium, the 
medium must be a type of memory component which is disclosed in the 
specification. 

Similarly claims 14-15 recite a computer program product which are essentially a 
programs (software program) and programs per se are non statutory. The 
Examiner suggests claiming the computer readable medium and not the 
program. "A computer readable medium encoded with computer readable 
program instructions, said computer readable program instructions comprising; a 
first computer readable program instruction for sixth data" 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-3,5 ,12 and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hsu et al (US 6078701) hereafter Hsu in view of Chen et al 
(US 6486908) hereafter Chen. 

1. Regarding claim 1 , Hsu discloses an image processing apparatus (Figs 1-3) 
for generating graphics data representing a single seamless planar image 
synthesized from a multiple sets of graphics data contained in a plurality of 
graphics files, in response to the plurality of graphics files each of which contains 
the graphics data composed of a multiplicity of planar pixels arrayed in a plane 
for representing a planar image, the image processing apparatus comprising: 

a feature point extractor configured to extract a feature point which is an 
area having a predetermined characteristic, from each of the plurality of 
spheroidal images (one to one correspondence with points in the scene at 
Col 1 lines 48-49,Col 4 Lines 65 mapping points between image frames are 
the features extracted from the images and Col 6 line 54-55 where each 
point is in one-to-one correspondence); 
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a correspondence relationship determiner configured to determine a 
correspondence relationship of the extracted feature points, between the plurality 
of spheroidal images (Fig 9 and Col 6 lines 36-67 where the mapping is 
explained); 

a spheroidal image synthesizer configured to generate seamless 
spheroidal graphics data representing a single seamless spheroidal image, by 
synthesizing a plurality of graphics data each of which representing each of the 
spheroidal images, with reference to the determined correspondence relationship 
(Fig 9 and Col 13 lines 61 through Col 14 lines 23); and 

a planar image generator configured to generate the graphics data 
representing the single seamless planar image, from the seamless spheroidal 
image graphics data (Col 12 lines 63 through col 13 lines 57 where reference 
to image mappings constitutes the planar image from the spherical 
reference). Hsu discloses area of the mosaic based on the perspective 
projection at col 6 lines 36-67 however does not explicitly recite a synthesis area 
establisher configured to establish a spheroidal projection plane centered on a 
predetermined point, as an area for synthesis of the multiple sets of graphics 
data and a spheroidal image generator configured to generate a plurality of 
spheroidal images, by projecting each of planar images represented by each of 
the multiple sets of graphics data onto the projection plane. 

Chen discloses a synthesis area establisher configured to establish a 
spheroidal projection plane centered on a predetermined point, as an area for 
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synthesis of the multiple sets of graphics data and a spheroidal image generator 
configured to generate a plurality of spheroidal images, by projecting each of 
planar images represented by each of the multiple sets of graphics data onto the 
projection plane (Figs 13,14 and 19 where the area or the rectangle 
determines the number of images can fit and a rectangular (planar) image 
can be used to represent the spherical environment map at Col 6 lines 42- 
43, abstract also discloses the number of photographs required using the 
center point of each photographs). Chen discloses that the method and 
system as disclosed builds the spherical panoramas based on the focal length of 
the camera, the height of the film and the overlapping ratio between the films 
thus avoiding the use offish eye lens giving a better panorama at Col 2 lines 39- 
50. Hsu and Chen are from the same field of endevour and are analogous art, 
therefore it would be obvious for one of ordinary skill in the art at the time the 
invention was made to use the teachings of Chen in the apparatus of Hsu for the 
above reasons. 

2. Regarding claim 2, Hsu and Chen disclose the image processing apparatus in 
accordance with claim 1 . Chen further disclose wherein the plurality of graphics 
files further include image attribute information which is attribute information of 
the graphics data (film height a, film width b, and focal length are the 
attributes Col 7 lines 20-25) wherein the image processing apparatus further 
comprises a focal distance determiner configured to determine a focal distance of 
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an optical system used to generate the multiple sets of graphics data for each of 
the multiple set of graphics data (focal length of the camera system col 2 lines 
64), in response to the image attribute information; and the spheroidal image 
generator generates the plurality of spheroidal images by projecting each planar 
image represented by each of the multiple sets of graphics data onto the 
projection plane, the each planar images being placed at a location away from 
the predetermined point to the projection plane side, by the focal distance 
corresponding to each of the multiple sets of graphics data (the number of 
circles landscape is the planar determination of the images using the focal 
length of the camera at col 2 lines 53-60). 

3. Regarding claim 3, Hsu and Chen disclose the image processing apparatus in 
accordance with claim 2. Chen discloses further the focal distance of the camera 
at (col 2 lines 53 through col 3), focal plane resolution, pixel size width and 
heights at (Col 6 lines 41-56). 

4 Regarding claim 5, Hsu and Chen discloses and apparatus in accordance to 
claim 2. Chen discloses further the focal plane resolutions at (Col 6 Lines 12- 
56). Chen discloses further the focal length and the angle (180 degree) divided 
by the focal length (f) at (Col 7 Lines 47-50). 
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5. Claim 12 is a corresponding method claim of claim 1 . See the explanation of 
claim 1. 

6. Claim 14 is a corresponding computer program product claim of claim 1 . See 
the explanation of claim 1 . 

Claims 6, 8 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lipscomb (US 6031541 ) hereafter Lipscomb in view of Hsu. 

7. Regarding Claim 6, Lipscomb discloses an image processing apparatus (Fig 
1) for generating graphics data representing a single seamless planar image 
synthesized from a multiple sets of graphics data contained in a plurality of 
graphics files, in response to the plurality of graphics files each of which contains 
the graphics data composed of a multiplicity of planar pixels arrayed in a plane 
for representing a planar image, the image processing apparatus comprising: 

a synthesis area establisher configured to establish a cylindrical projection 
plane centered on a predetermined axis, as an area for synthesis of the multiple 
sets of graphics data (Fig 12 which shows the number of pictures needed 
and constitutes the area of the mosaic, Figs 3 and 4 shows multiple 
rectangular areas and the axis and projections with respect to the cylinder); 

a cylindrical image generator configured to generate a plurality of 
cylindrical images, by projecting each of planar images represented by each of 
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the multiple sets of graphics data onto the projection plane (Figs 5 and 12 which 
shows multiple cylindrical images projected and aligned in form of a 
mosaic in fig 12); a cylindrical image synthesizer configured to generate 
seamless cylindrical graphics data representing a single seamless cylindrical 
image, by synthesizing a plurality of graphics data each of which representing 
each of the cylindrical images, with reference to the determined correspondence 
relationship; and a planar image generator configured to generate the graphics 
data representing the single seamless planar image, from the seamless 
cylindrical image graphics data at (Col 6 lines 21-30 where the cylinder is 
"unrolled" to for a large planar rectangle consisting of the panoramic 
graphics image). Lipscomb discloses the color extraction (color of the 
panoramic scene at Col 2 line 67 through Col 3 lines land Col 10 lines 35- 
47 explains the color features) and the correspondence mapping at (Fig 20 
elements 205-207 the correspondence between the images are determined), 
however does not expressly recite 

a feature point extractor configured to extract a feature point which is an 
area having a predetermined characteristic, from each of the plurality of 
cylindrical images and a correspondence relationship determiner configured to 
determine a correspondence relationship of the extracted feature points, between 
the plurality of cylindrical images. 

Hsu discloses a feature point extractor configured to extract a feature 
point which is an area having a predetermined characteristic, from each of the 
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plurality of cylindrical images and a correspondence relationship determiner 
configured to determine a correspondence relationship of the extracted feature 
points, between the plurality of cylindrical images (one to one correspondence 
with points in the scene at Col 1 lines 48-49,Col 4 Lines 65 mapping points 
between image frames are the features extracted from the images, Col 4 
lines 56-57 where cylindrical surface is disclosed and Col 6 line 54-55 
where each point is in one-to-one correspondence). Hsu discloses that the 
system and method as disclosed accurately constructs seamless panoramic 
image from the sequence of images using topology, global registration at (Col 2 
Lines 53-60). Therefore it would be obvious for one of ordinary skill in the art at 
the time the invention was made to have used the teachings of Hsu in the 
apparatus of Lipscomb to achieve the claimed invention. 

8. Regarding claim 8, Lipscomb and Hsu disclose the image processing 
apparatus in accordance with claim 6. Lipscomb discloses further wherein the 
cylindrical image generator establishes the axis parallel to the height direction 
established in the graphics data (Fig 18 where the axis of the cylinder is 
parallel to the height of the images). 

9. Claim 13 is a corresponding method claim of claim 6. See the explanation of 
claim 6. 
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Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hsu in 
view of Chen and in further view of Muramatsu. (US 5438380) hereafter 
Muramatsu.. 

10. Regarding claim 4, Hsu and Chen disclose the image processing apparatus 
in accordance with claim 2. Hsu and Chen both disclose photographic films (for 
eg Chen Col 3 Lines 59-67). Chen further discloses the spheroidal image 
generator determines 35 mm film size as a size of the planar image (Figs 13,14 
and 19 where the area or the rectangle determines the number of images 
can fit and a rectangular (planar) image can be used to represent the 
spherical environment map at Col 6 lines 42-43, abstract also discloses the 
number of photographs required using the center point of each 
photographs), discloses the focal length of the camera system and the film 
height and the width (at col 3 Lines 1-18) however do not expressly recite 
wherein the image attribute information includes 35 mm-equivalent lens focal 
distance which is a value of focal distance converted to a 35 mm film camera 
basis; the focal distance determiner determines the 35 mm-equivalent lens focal 
distance to be the focal distance. 

Muramatsu discloses the focal distance (length) of the film from 25mm to 
35 mm and the image reproduced (Col 2 lines 18). Muramatsu discloses that the 
camera provides aspect ratio of good appearance of the photographic images 
when used in panoramic format (Col 1 lines 40-45 and 55-56). Muramatsu, Hsu 
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and Chen are from the same field of endeavor and are analogous art, therefore it 
would be obvious for one of ordinary skill in the art at the time the invention was 
made to have used the teachings of Muramatsu in the apparatus of Hsu and 
Chen for the above reasons. 

Claims 7, 9, 1 1 and 15 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lipscomb in view of Hsu and in further view of Chen et al (US 
6486908) hereafter Chen. 

11. Regarding claim 7, Lipscomb and Hsu disclose the image processing 
apparatus in accordance with claim 6. Lipscomb discloses the attributes of the 
images such as height and width of the images (Figs 18,19) being used in the 
panorama construction. Lipscomb and Hsu are silent and however do not 
expressly disclose wherein the plurality of graphics files further include image 
attribute information which is attribute information of the graphics data, wherein 
the image processing apparatus further comprises a focal distance determiner 
configured to determine a focal distance of an optical system used to generate 
the multiple sets of graphics data for each of the multiple set of graphics data, in 
response to the image attribute information; and the axis image generator 
generates the plurality of axis images by projecting each planar image 
represented by each of the multiple sets of graphics data onto the projection 
plane, the each planar images being placed at a location away from the 
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predetermined axis to the projection plane side, by the focal distance 
corresponding to each of the multiple sets of graphics data. 

Chen discloses the focal length of the camera system (Col 3 lines 10) and 
constructs a warped images of each of the photographic images using the 
attributes (color) at (Col 3 lines 55-60, Col 12 lines 1-32) and thus constructing 
a seamless spherical image from the warped images and thus one of ordinary 
skill in the art would be able to extend the teachings of Chen in construction of 
cylindrical panoramas. Even the height and width of the film can be understood 
as the attributes. Chen discloses that the method and system as disclosed builds 
the spherical panoramas based on the focal length of the camera, the height of 
the film and the overlapping ratio between the films thus avoiding the use offish 
eye lens giving a better panorama at Col 2 lines 39-50. Lipscomb, Hsu and 
Chen are from the same field of endeavor and are analogous art, therefore it 
would be obvious for one of ordinary skill in the art at the time the invention was 
made to use the teachings of Chen in the apparatus of Lipscomb and Hsu for the 
above reasons. 

12. Regarding claim 9, Lipscomb, Hsu and Chen disclose the image processing 
apparatus in accordance with claim 7. Lipscomb discloses further pixel or image 
height at (Col 12 lines 1-3), pixel width direction at (Col 13 lines 1-12). Chen 
also discloses the focal plane resolutions at (Col 6 Lines 12-56). 
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13. Regarding claim 1 1 , see the explanation of claim 9 and also see the angle 
over width calculation at (Col 13 line 42 in Lipscomb). 

14. Claim 15 is a corresponding computer program product claim of claim 6. See 
the explanation of claim 6. 

Claim 10 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Lipscomb, Hsu, Chen and in further view of Muramatsu. 

15. Regarding claim 10, Lipscomb, Hsu and Chen disclose the image 
processing apparatus in accordance with claim 7. Lipscomb, Hsu and Chen 
discloses the photographic film however do not expressly recite 35 mm film size. 
Muramatsu discloses the focal distance (length) of the film from 25mm to 35 mm 
and the image reproduced (Col 2 lines 18). Muramatsu discloses that the 
camera provides aspect ratio of good appearance of the photographic images 
when used in panoramic format (Col 1 lines 40-45 and 55-56). Muramatsu, 
Lipscomb, Hsu and Chen are from the same field of endeavor and are analogous 
art, therefore it would be obvious for one of ordinary skill in the art at the time the 
invention was made to have used the teachings of Muramatsu in the apparatus 
of Lipscomb, Hsu and Chen for the above reasons. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JAYESH A. PATEL whose telephone number is 
(571)270-1227. The examiner can normally be reached on M-F 7.00am to 4.30 
pm (5-4-9). If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Jingge Wu can be reached on 571-272-7429. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. Information regarding the status of an application may 
be obtained from the Patent Application Information Retrieval (PAIR) system. 
Status information for published applications may be obtained from either Private 
PAIR or Public PAIR. Status information for unpublished applications is available 
through Private PAIR only. For more information about the PAIR system, see 
http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 
(toll-free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 
09/2/08 

/Jayesh A Patel/ 
Examiner, Art Unit 2624 

/Samir A. Ahmed/ 

Supervisory Patent Examiner, Art Unit 2624 



